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Abstract. We show that the second oversampling theorem for affine systems 
generates super- wavelets. These are frames generated by an affine structure 
on the space L^(R'*) © ... ® L^(R''). 

p times 



1. Introduction 

While, as is well known the study of wavelets draws from a variety of areas of 
mathematics, and wavelet algorithms have numerous applications, in this paper we 
focus on an operator theoretic aspect of the subject. We feel that our approach 
clarifies fundamental techniques in the subject, and at the same time may be of 
independent interest in operator theory and in analysis. Some key ideas begin with 
early engineering applications; e.g., to speech, and to time-series. Here "oversam- 
pling" refers to certain redundancies that are introduced into signal processing. 
When our problem is formulated in the context of a fixed Hilbert space, we have 
a useful notion of dilation (or extension) available from operator theory; that of 
passing to a bigger Hilbert space H (a "super space") where bases and discrete 
transforms work without redundancies, and where as a result computations sim- 
plify. Even certain symmetries are better understood in the super space H. In the 
end, answers can be restricted back to smaller Hilbert space again. 

The subject of wavelets originates with a dual track of algorithms; one in func- 
tion theory, and one in signal processing. Examples: subband coding, pyramid 
algorithms, multiresolutions, adaptive bases, and data compression with threshold- 
ing. 

First recall from the wavelet literature (e.g., |H|) that fundamentals from signal 
processing may be thought of and understood within the framework of operator 
algebra and representation theory. In fact, this viewpoint is almost ubiquitous and 
it may be used to advantage in a wider context of mathematical analysis ; i.e., used 
in processes which select and analyze special bases in function spaced. It applies 
even more generally when the notion of an orthonormal basis (ONB) in Hilbert 
space is extended in such a way to allow instead frames. A frame system is defined 
rigorously in equation H2.1|l below. Within the family of wavelet bases, frames have 
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the advantage of encompassing wavelet bases that allow more symmetries that can 
be accommodated by ONB-wavelets. This is critical to applications, for example 
to the algorithms used in digital fingerprint compression, see e.g., 0. For these, 
symmetry is a critical feature, and so orthogonality must be relaxed. (See e.g., 
[3 Chapter 6].) The bases we consider in this paper serve as framework for both 
discrete signal processing and more function theoretic models. A leading theme in 
our analysis is the interplay between the two. A key link between the two is provided 
by time-frequency analysis. We begin in section 3 with a formulation of Fourier 
duality which is tailored to our presentation of "oversampling" as part of super- 
wavelets. The term "oversampling" is from signal processing and coding theory. 
Starting with a prescribed sample point, there are reasons for "oversampling", i.e., 
the addition of more sample points, or generation of redundancies: for example, the 
redundancies may allow error detection and/or error correction. A concrete way to 
pass to a desired oversampling is to start with sample points which are restricted 
to a fixed lattice L in M'^, i.e., a rank-c? abelian and discrete subgroup of . It 
follows that a bigger lattice L' of sample points may then be represented in the form 
PL' = L where P is an invertible and integral d by d matrix; i.e., L' = P^^L. In 
the case a frame system is first created in the Hilbert space L^(R'*) from a suitably 
chosen pair {L, P) where L is a lattice and P is a scaling matrix, we show that the 
super-Hilbert space H may then be realized as a p-fold orthogonal sum of L^(R'*) 
with itself where p — \ det P\. Moreover we give explicit formulas for the respective 
actions in the two Hilbert spaces which in turn are expressed and explained in terms 
of "oversampling" . 

We use the term sampling in the sense of Shannon. Shannon showed that a 
function / on the real line R which has its Fourier transform / supported in a 
bounded interval can be reconstructed by interpolation of its values resulting from 
sampling at integral multiples of a certain rate v, i.e., {f{ni') \ n € Z}. (Functions / 
with Fourier transform / of compact support are called band-limited. We shall adopt 
this convention even if / is a function in several variables.) Shannon's theorem has 
now found a variety of generalizations and refinements, and it is standard fare in 
both Fourier analysis and in applied mathematics. Given the finite support of /, it 
is well known that there is an optimal rate v (the Nyquist rate) which gives exact 
reconstruction of the function from its samples. Nonetheless, there are instances 
where it is either desirable or unavoidable to sample beyond the Nyquist rate, 
resulting in a larger, oversampled set of discrete sample points. Shannon's formula 
even has a formulation in Hilbert space in terms of reproducing kernels, but we shall 
be concerned here with wavelet bases. One way to view Shannon's interpolation 
is to think of the interpolation formula for the function / as an expansion into a 
reproducing system for L^(R), or analogously for L^(R'*) in higher dimensions. As 
is well known, the reproducing systems take the form of frames (see j/7j and f4j), 
and moreover the class of frames include wavelets, or rather wavelet bases which 
constitute frames, see eq (|2.1|l below. We shall be concerned with this framework 
for oversampling, and our results are in the context of the Hilbert space L'^{M.'^). 
This means that our sampling points will typically constitute a rank-d lattice, i.e., 
a discrete subgroup of R'' of rank d. 



OVERSAMPLING GENERATES SUPER- WAVELETS 



3 



2. A FRAME OF FUNCTIONS ON M'' 

While the early results are based on Shannon's ideas, the subject received a 
boost from advances in wavelets and frames, and a number of authors have re- 
cently extended and improved the classical sampling and reconstruction results. 
An intriguing extension is to the non- uniform case, i.e., when the sampling points 
are not necessarily confined to a lattice in R*^. The paper P and the book |5] 
contain a number of such new results, and they offer excellent overviews. 

For the case of one or several real variables, there is a separate generalization of 
standard dyadic wavelets, again based on translation and scaling: And there is a 
powerful approach to the construction of wavelet bases in the Hilbert space i^(R^), 
i.e., of orthogonal bases in L^(M''), or just frame wavelet bases, but still in L^(R''). 

Of course, the best known instance of this is d = 1, and dyadic wavelets jZj. In 
that case, the two operations on the real line M are translation by the group Z of 
the integers, and scaling by powers of 2, i.e., a: i-^ 2-', as j runs over Z. This is the 
approach to wavelet theory which is based on multiresolutions analyses and filters 
from signal processing. In higher dimensions d, the scaling is by a fixed matrix, and 
the translations by the rank-d lattice Z'^. Again we will need scaling by all integral 
powers. We view points x in R'' as column vectors, and we then consider the group 
of scaling transformations, x t—^ IvP x as j ranges over Z. 

Let A/ be a d X d dilation matrix with integer entries, such that all the eigen- 
values A of M satisfy |A| > 1. The dilation operator induced by Ad is Df{x) := 
^\dct M\f{Mx), for / e L^iR"^). 

For u S M"^, let T„ denote the translation operator by Tuf{x) f{x — u). 

Let H he a. Hilbert space. A collection of vectors {e; | i e /} in iJ is called a 
frame if there are some constants A,B > Q such that, for all f E H, 

(2.1) A\\fr<J2\{f\e^)?<B\\fr. 

The constants A and B are called the lower and the upper frame bounds. 

Our use of the term oversampling is motivated as follows: We start with a 
frame system in d real dimensions which is based on scaling by a fixed expansive 
matrix M; and we normalize the setting such that our initial set of sample points 
will be located on the standard rank-d lattice Z'^. We then introduce a second 
d X d matrix P (having integer entries) and consider the larger lattice of sample 
points, P^^TJ^. The two matrices M and P must satisfy a certain compatibility 
condition (generalizing the notion of relative prime for numbers) ; Definition 12.11 
In our theorem fTheorem l3.1|l we compare our two frame systems before and after 
oversampling. 

We now turn to our affine frame systems, and their oversampled versions. 
Let ^ = {V^i, V'n} C L^(R'^). The affine system generated by ^' is 

X{^) := {D^TkAlj e Z,k eZ'',l £ {1, ...,n}}. 

Let P he a, dx d integer matrix. Denote hy p :— \ det P\. The oversampled affine 
system generated by 4" relative to P is 

X^(^') := {-^i?^Tp-ife^,|jeZ, A; eZ^ze {!,..., 7i}}. 

It is helpful to view sampling in context of L^(M'')-wavelets. Start with an afhne 
wavelet frame system in the Hilbert space L^(K''). Our general idea is then to 
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represent oversampling for such an affine frame basis in L^(M'^) as follows: While 
the initial frame system in L^(R'*) will have redundancy, we show that there is a 
specific "larger" Hilbert space such that by passing to this ambient Hilbert space, 
we will then get exact (Nyquist type) sampling. In fact we show that the "larger" 
Hilbert space takes the form of an orthogonal sum of L2(M'') with itself a finite 
number of times p say, where p depends on the amount of oversampling. 

Definition 2.1. The matrix P is called an admissible oversampling matrix for M 
(or simply admissible) , if the matrix PMP~^ has integer entries and 

M^^z^^ n p-'^iJ^ = u^. 

The second oversampling theorem states that, when P is admissible, if the afhne 
system X{'^) is a frame for L^(R'') then the oversampled affine system X^{'^) is 
a frame for L^(M'^) with the same frame bounds. This type of oversampling was 
introduced by Chui and Shi in [2] for one dimension and scaling by 2. Since then, 
the result has been generalized and has become known as "the second oversampling 
theorem" ; see ^1 |S1 El H] ■ For details on the history of the second oversampling 
theorem we refer to 0. 

In this paper we will prove that, in fact, more is true: if we oversample with 

a matrix P we will obtain frames in the larger space H := L^{R'^)® ...®L^{W^)■ 
'' . ■' 

p times 

Specifically, we prove the following: 

Theorem lOl Let d be given, and let two integral d by d matrices M and P 
satisfy the conditions in Definition \2.1\ Starting with an M -scale frame in 
L^(R'^), let {'^) be the corresponding P -oversampled frame. Then there is an 
isometric and diagonal embedding of L'^{M.'^) in H and a third frame in H with the 
same frame bounds, such that X^{'^) arises from it as the projection onto the first 
component. 

These "super-frames" are also generated by an affine structure on H . In addition, 
the oversampled system X^(^) can be recovered as the projection of the super- 
frame onto the first component. Moreover, when the affine system is an orthonormal 
basis, the corresponding super-frame is also an orthonormal basis for H. 

These results generalize also Theorem 5.8 in |2] which treated the case of tight 
frames in dimension d — 1. 

3. Statement of the results 

We will assume that P is an admissible oversampling matrix for M . We denote 
by M' :=: PMP"^. 

Let {Or |0<r<p — l}bea complete set of representatives for P^^U^ jU^ . We 
can take 6*0 = 0. The dual of this group is {P*)-^TL'^ jU^ , and let {6i* | < g < p- 1} 
be a complete set of representatives for this group. We can take Qq = 0. The duality 
is given by 

Since P is admissible, the matrix M induces a permutation a oi \r\Q < r < 
p - 1}, MQr = 6'„(r) mod Z'^ (see P Proposition 2.1]). 
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The dual of this map induces a permutation a* of {q | < g < p — 1}, AI'*0* = 
9„'(q) mod Z'^. 
Indeed, 

Define the Hilbert space 

p times 

On this Hilbert space we define an affine structure generated by a dilation operator 
D, and the translation operators Tp-i^., k G TI^ . 
For the matrix M define the unitary operators: 

Tp-ife(/g)o<g<p-i = (e^''''''^'Tp-is,/q)o<g<p-i, (fc e 

D(/<;)o<g<p-l = (-D/(o.')-i(g))o<g<p-l- 

The operators satsify the commutation relation 
(3.1) DTMP-ifc = Tp-i,.D, (fc e TJ"). 

For / e define 5/ G i? 

S is an isometry. 

Theorem 3.1. Let \1> := {V"!, '(/'n} C L^(M''). T/ie Ojfjine system X{^) is a 
frame (orthonormal basis) for Lp'iW^) if and only if 

X(S'«') := {D^Tp-ifeS'V'^ |j e Z,fc e e {i,...,7i}} 

is a frame (orthonormal basis) for H with the same frame bounds. The projection 
ofli-{S'^) onto the first component is the oversampled affine system X^{'^). 

4. Proof of theorem 13.11 

We start with a lemma. 
Lemma 4.1. The matrix 



1 

0<r,g<p— 1 



'U:=^{e™ 



is unitary. 

Proof. This is a well-known fact from harmonic analysis. The matrix is the matrix 
of the Fourier transform on the finite abelian group P^^J/^ /U^ . □ 

It will be convenient to make a change of variable x ^ Px. Let D' be the 
corresponding dilation operator D'f{x) = det M'\f{M'x), for / e i^(M''). 
For the matrix M', define the unitary operators: 

T^'kif<})0<q<p-1 = {e'^'"''''^''Tkfq)Q<q<p-l, {k G Z''); 
D'(/g)o<g<p-l = (£''/(<T*)-i(g))o<g<p-l. 

They satisfy the commutation relation 

(4.1) D'TVfe^nD', [kG-L"). 



6 DORIN ERVIN DUTKAY AND PALLE JORGENSEN 

The two affinc structures {D,T p-if.} and {D',T'j,} are conjugate. Define the 
unitary operator Up on L^(M'^) by Upf{x) = ^f{Px). Then 

UpD' - DUp, UpTk - Tp-ikUp, (fc e Z"^). 

Define the unitary operator Up on iJ 

Up(/o, ...Jp-i) = (Upfo, C/p/p-i). 

Then 

UpD' = DUp, UpT'fe = Tp-ifeUp, {keZ'^). 

Also if 

then S" is an isometry and 

This shows that 

UpD'^T'fc^'/ - D^Tp-ifc^/, (j G Z, fc e / e 

In order to show that X(S''J') is a frame with given frame bounds it is enough 
to prove that 

X(S"*) {D'^T^.S'V^ I j e Z,fc e Z^i e {!,..., n}} 
is a frame with the same frame bounds. 

Lemma 4.2. Each f (z H can be written uniquely as 

p-i 

for some fo, fp-i G L^{R'^). 
Proof. Let g = {gq)q £ H. We want 

Equivalently, in matrix form, 



{gq{x))q = H*{^fr{P-\x - PBr)))r. 

Using lemma ITTl we get 

{^fr{P-\x - P9r)))r = (7^* ) (ff, (x) )„ 

and this uniquely determines f^, and /,. G □ 

Lemma 4.3. For f,ge L'^{R'^), fc G Z'', j G Z and r G {0, ...,_p- 1}, we have 

(B'^TiS'f I T'pe^S'g) = <5,^,,(,) (D^Tp-^J \ Tg^g) , 
where I G {0, — 1} is determined by k = P6i + Pm, with m G Z"*. 
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Proof. First compute 

{T)''TiS'f){x) = f-e''"'"^'(''}-H.) ^ {det My f{p-\M'^x ~ k))\ 



Therefore 

p-i 



{D'^%S'f\T'p,^S'g)^Yl I 4e 



i" ) Hi) 



■y/{detM'yf{p-\M'^x - k))g{p-\x - Per))dx. 

But 

_ \ g ^ 9' — _ X g ^ (<T*) 3(g) 

^ q=0 ^ q=0 



1 



q=0 

We used Lemma [4. II in the second to last equahty. 
Then 

- y/{dct My f{p-\M'~^x - k))g{p-\x -P9r))dx = 

L2(R'i) P 

[ - {det M)3 f{M^p-^x - p-^k)g{P~^x - 9r) dx = 

f ^ {det My fiM^y - P~^k)g{y - Or) dx = {D^Tp-i^f \ Tg^g) . 

This proves the lemma. □ 

Lemma and Lemma show that the Hilbert space H can be written as an 
orthogonal sum 

H^Ho®Hi®-®Hj,^i, Hr = %S'L^{M.'^). 
Moreover the set X(S"^') splits into p mutually orthogonal subsets 

y.r{S'^) := {D'^T'p, ,p^S'yj,\j e Z,m e Z^z e {!,... ,n}} C H^. 

Also note, as another consequence of Lemma ITTSl that the unitary D''^ maps P{f 
onto H„-j(j.)- 

Therefore it is enough to show that Xr(S"^) is a frame with the same frame 
bounds for Hr. We have, with Lemma lOl for / G L^(M''): 
(4.2) 

J2 I (d'-'T'p,^^^^^+p„5V. I T'p,, ,57) I' = E I (^'T^«„.<.,+™^» I Tej) p. 

i,j,m 

But according to the proof of Theorem 3.2 in [S], this quantity is bigger than 
AllTeJp = = A\\Tpg^S'ff. This yields the lower bound. 

For the upper bound, we have, using (|4.1(l : 

E E I (D"Tk.,.-..>..+p™^>^ I ^'/> I' = 

2,m j>0 
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But P9„j(^r) ~ PMWr — Ph for some h e Z'^, therefore, with Lemma [4. HI 

= E E I {D'T.n'^^^ I /) P < B\\ff = B\\Tpe,.S'fr. 

Now take J > 0. Using the fact that D''^ permutes the subspaces Hr, we can 
write 

for some /' G L'^{R'^), with ||/'|| = ||/||. Then 

E \{'D''T'pe^^^^^+PrnS'^^\T'p,^S'f)\' = 

i,m j> — J 

J2 E I (d'-'T'p,^.,.,+p™^V* I _,,^,^7') P < B\\r\\ = B\\T'p,^S'fr- 

i,m j>0 

Letting J ^ cxd we obtain the upper bound. 

This proves the first statement of the theorem. If X{'^) is an orthonormal basis 
then X(S'4') is a frame with bounds A — B — 1. Also the norm of the 5^ is 1, so 
X(5^) is an orthonormal basis. 

For the converse, take r = in H4.2(l . We know that Xo(S"vE') is a frame for 
Hq, because the families Xr(S"^') are mutually orthogonal. Then we use (|4.2|) and 
conclude that X{'^) is also a frame with the same frame bounds. 

The projection onto the first component Vq corresponds to 9^ — 0. Since 
a*{d^) = 6*5, we obtain 7'o(X(5«')) = This concludes the proof of Theorem 

Note that from the proof of Theorem 13. II and equation (|4.2|l . we obtain also the 
following corollary 

Corollary 4.4. If X{ip) is a frame for (M) then for all r e {0, ■■■,p— 1} 

{D^Tg^^^^^^+miJ^\J G Z, m G 2 G {l,-,n}} 
is a frame with the same bounds for L'^{M.'^). 

Remark 4.5. In our discussion above, we have stressed uniform sampling, i.e., the 
case when the sample points are located on a suitably chosen lattice in R"^, and 
we then analyzed refinements of lattices as an instance of oversampling. But the 
operator theory going into our method applies also to the more general and perhaps 
more interesting case of non-uniform case, also called irregular sampling; see e.g., 
and [2] for related modern results. Since the results are more clean in the case 
of lattice-refinement, we have stated our theorem in this context. 
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